Meteor Universal: Language Specific Translation Evaluation for Any Target Language
نویسندگان
چکیده
Parameter set learned using all WMT12 data (Callison-Burch et al., 2012): • 100,000 binary rankings covering 8 language directions. •Restrict scoring for all languages to exact and paraphrase matching. Parameters encode human preferences that generalize across languages: •Prefer recall over precision. •Prefer word choice over word order. •Prefer correct translations of content words over function words. •Prefer exact matches over paraphrase matches, while still giving significant credit to paraphrases. Visualization
منابع مشابه
Packing it all up in search for a language independent MT quality measure tool
This study describes usage of a particular implementation of Normalized Compression Distance (NCD) as a machine translation quality evaluation tool. NCD has been introduced and tested for clustering and classification of different types of data and found a reliable and general tool. As far as we know NCD in its Complearn implementation has not been evaluated as a MT quality tool yet, and we wis...
متن کاملPacking It All Up in Search for a Language Independent MT Quality Measure Tool - Part Two
This study describes first usage of a particular implementation of Normalized Compression Distance (NCD) as a machine translation quality evaluation tool. NCD has been introduced and tested for clustering and classification of different types of data and found a reliable and general tool. As far as we know NCD in its Complearn implementation has not been evaluated as a MT quality tool yet, and ...
متن کاملFacing The Machine Translation Babel in CLIR – Can MT Metrics Help in Choosing CLIR Resources?
This paper describes usage of MT metrics in choosing the best candidates for MT-based query translation resources in Cross-Language Information Retrieval. Our metrics is METEOR. Language pair of our evaluation is English → German, because METEORmetrics does not offer very many language pairs for comparison. English → German has also available many MT programs that can be used in evaluation. We ...
متن کاملLanguage Learning Materials Development for Teachers’ Professional Development
Coursebooks are normally written to contain information, instruction, exposure, and activities that learn- ers at a particular level need to enhance their communicative competence in the target language. Howev- er, many global course books make attempts to include content, topics, and texts that do not disadvantage any learner around the world. That is why global course books normally do ...
متن کاملMachine Translation on the Medical Domain: The Role of BLEU/NIST and METEOR in a Controlled Vocabulary Setting
The main objective of our project is to extract clinical information from thoracic radiology reports in Portuguese using Machine Translation (MT) and cross language information retrieval techniques. To accomplish this task we need to evaluate the involved machine translation system. Since human MT evaluation is costly and time consuming we opted to use automated methods. We propose an evaluatio...
متن کامل